Lecture � Rolls NN � Pattern associated memory

Introduction

Hebb�s rule 1949

association rule: co-activity tween input/output

if you have the pre-synaptic input present at the same time as the output firing

 

work out which is the receiving/sending neuron

connectionists: horizontal

rolls/anatomists: vertical

 

firing rate r

 

r prime = firing rate of input axon

 

synaptic weights/strengths w

weight from the jth input onto the ith output

 

if post-synaptic potential exceeds threshold, then fires

 

Activation functions

 

linear

threshold linear

sigmoid activation function � like the brain, S-shaped curve

binary threshold

 

hebb rule - if you have the pre-synaptic input present at the same time as the output firing � multiplication: if one is not present, then multiply by zero

 

linearly re-weighted sum

 

decrease the synaptic weight too?

 

Properties of pattern association memory